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(54) Image processing circuit and method for processing image 



(57) The present invention relates to an image 
processing circuit and an image processing method : 
and is applied to, for example, a video camera, an elec- 
tronic stiil camera and the like, for compressing the dy- 
namic range at a high compression rate with evading 



the lowering of an impression concerning the contrast 
and the unnatural edge emphasis. The present inven- 
tion smoothes an input image X while preserving the 
edge to obtain a gain correction coefficient, and corrects 
the pixel value x(i, j) of the input image X with the gain 
correction coefficient. 



Q. 
LU 



FIG.4 



* 



CM 
< 

00 
LO 
CM 

r- 



x(i,j) 



4 

± 



DELAY 
CIRCUIT 



2 



NON-LINEAR 
SMOOTHING 
UNIT 



s(i,j) 
S 



3 

± 



LUT 



-Kx) 



5 z(ij) 



G 

g(i. j) 



6 
LUT 



Y 

yOJ) 



Printed by Jouve, 75001 PARIS (FR) 



1 



EP 1 137 258 A2 



2 



Description 

BACKGROUND OF THE INVENTION 

1 . Field of the Invention: 5 

[0001] The present invention relates to an image 
processing circuit and a method tor processing an im- 
age, and is applicable to, for example, the processing 
and the recording of the results of imaging with a video 10 
camera, an electronic still camera and the like, image 
displaying on a liquid crystal display and the like : image 
processing and image synthesis with a personal com- 
puter and the like, and image transmission by means of 
those apparatus. 15 

2. Description of the Related Art: 

[0002] In conventional various image processing cir- 
cuits such as an imaging apparatus, various kinds of 20 
processing such as recording and reproducing are per- 
formed after the dynamic range of an image is com- 
pressed. 

[0003] As for such processing of compressing the dy- 
namic range, there are a method in which the gradation 25 
(gray scale) of the whole image is corrected and a meth- 
od in which the gradation of only the low frequency com- 
ponents of an image is corrected. In the former method, 
the dynamic range is compressed by a correction of the 
gradation such as a gamma correction, a knee correc- 30 
tion and so-called histogram equalization. On the other 
hand, in the latter method, the dynamic range is com- 
pressed by a correction of the gradation such as the 
gamma correction and the knee correction. 
[0004] However, there is a problem that these dynam- 35 
ic range compressing methods are not practically suffi- 
cient. 

[0005] That is, by the method in which the gradation 
of the whole image is corrected by the gamma correc- 
tion, the knee correction and the like, the contrast of an 40 
object as well as the dynamic range is compressed in a 
brightness region to be compressed, such as a bright- 
ness region including few highlight parts and histo- 
grams. Accordingly, the method has a problem that it is 
difficult to increase the compression rate of the dynamic 45 
range and a problem that an image having a low contrast 
and few variations is generated owing to the compres- 
sion of the dynamic range. 

[0006] On the other hand, in the method in which the 
gradation of only the low frequency components is cor- 50 
rected by the gamma correction, the knee correction 
and the like, a ratio of the low frequency components to 
the high frequency components of an image changes 
owing to the compression of the dynamic range. Owing 
to this change, the method has a problem that the edges 55 
of an image are unnaturally emphasized by the com- 
pression of the dynamic range and an image with de- 
graded quality is generated. 



SUMMARY OF THE INVENTION 

[0007] The present invention was made in consider- 
ation of the aforesaid problems, and provides an image 
processing circuit or a method for processing an image, 
that may be used for various types of apparatus han- 
dling image data such as an imaging apparatus, an im- 
age display apparatus, an image data transmission ap- 
paratus. 

[0008] The image processing circuit and method of 
the present invention are capable of compressing the 
dynamic range of an image while avoiding lowering of 
an impression concerning the contrast and unnatural 
edge emphasis of the image so as to compress the dy- 
namic range of the image at a higher compression rate. 
[0009] For solving such problems, according to a first 
aspect of the present invention . there is provided an im- 
age processing circuit or a method for processing an im- 
age, in which a pixel value of an input image is smoothed 
while preserving an edge of the input image and a gain 
correction coefficient is generated according to an out- 
put value of the smoothing processing to correct the pix- 
el value of the input image. 

[0010] According to the configuration of the first as- 
pect, when the pixel value of the input image is 
smoothed while preserving the edge of the input image, 
only the component determining the dynamic range of 
the input image can be extracted from the input image 
separately. Accordingly, when the gain correction coef- 
ficient is generated according to the output value of the 
smoothing processing to correct the pixel value of the 
input image, the lowering of the contrast of an object 
that is independent of the dynamic range of the image 
and is desired to be preserved without compressing it is 
effectively evaded, and the dynamic range can be com- 
pressed at a desired compression rate. Moreover, be- 
cause the lowering of the contrast of the object can ef- 
fectively evaded, the unnatural edge emphasis can also 
be prevented, and thereby the dynamic range of an input 
image can be compressed at a high compression rate 
while quality of the input image is maintained. 
[001 1] As described above, according to the present 
invention, a pixel value of an input image is smoothed 
while preserving an edge of the input image to obtain a 
gain correction coefficient, and the pixel value of the in- 
put image is corrected on the basis of the gain correction 
coefficient. Consequently, the lowering of an impression 
concerning the contrast and the unnatural edge empha- 
sis of the image are effectively evaded, and it becomes 
possible to compress the dynamic range of the image 
at a higher compression rate. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[001 2] The above and other objects, features and ad- 
vantages of the present invention will become more ap- 
parent from the following description of the presently 
preferred exemplary embodiments of the invention tak- 
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en in conjunction with the accompanying drawings, in 
which: 

Fig. 1 is an illustration showing equations 1 ; 

Fig. 2 is an illustration showing equations 2; 5 

Fig. 3 is an illustration showing equations 3; 

Fig. 4 is a block diagram showing an image 

processing circuit according to a first embodiment 

of the present invention; 

Figs. 5A-5D are timing charts for illustrating the op- io 
eration of the image processing circuit shown in Fig. 
4; 

Fig. 6 is a characteristic curve diagram showing a 
characteristic of the lookup table 3 of the image 
processing circuit shown in Fig. 4; is 
Fig. 7 is a characteristic curve diagram showing a 
characteristic of the lookup table 6 of the image 
processing circuit shown in Fig. 4; 
Fig. 8 is a block diagram showing the non-linear 
smoothing unit of the image processing circuit 20 
shown in Fig. 4; 

Figs. 9A and 9B are timing charts for illustrating the 
operation of the non-linear smoothing unit shown in 
Fig- 8; 

Fig. 1 0 is a timing chart for illustrating the operation 25 
of the improved e filter of the non-linear smoothing 
unit shown in Fig. 8; 

Fig. 11 is a block diagram showing the improved e 
filter of the non-linear smoothing unit shown in Fig. 
8; 30 
Fig. 12 is a block diagram showing the delay circuit 
of the improved € filter shown in Fig. 11 ; 
Fig. 13 is a block diagram showing the arithmetic 
operation circuit of the improved e filter shown in 
Fig. 11; 35 
Fig. 14 is a characteristic curve diagram for illustrat- 
ing a characteristic of the lookup table 3 of the im- 
age processing circuit shown in Fig. 4; 
Fig. 15 is a block diagram showing an image 
processing circuit according to a second embodi- 40 
ment of the present invention; 
Figs. 1 6A-1 6F are time charts for illustrating the op- 
eration of the image processing circuit shown in Fig. 
15; 

Fig. 17 is a block diagram showing an image 45 
processing circuit according to a third embodiment 
of the present invention; 

Fig. 1 8 is a characteristic curve diagram for illustrat- 
ing a characteristic of the lookup table 52 of the im- 
age processing circuit shown in Fig. 15; so 
Fig. 19 is a block diagram showing an image 
processing circuit according to a fourth embodiment 
of the present invention; 

Figs. 20A-20C are timing charts for illustrating the 
operation of the image processing circuit shown in 55 
Fig. 19; and 

Fig. 21 is a block diagram showing an image 
processing circuit according to a fifth embodiment 



of the present invention. 

DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

[0013] Hereinafter, the embodiments of the present 
invention will be described in detail by suitable reference 
to the attached drawings. 

(1) CONFIGURATION OF FIRST EMBODIMENT 

(1-1) WHOLE CONFIGURATION OF FIRST 
EMBODIMENT 

[0014] Fig. 4 is a block diagram showing an image 
processing circuit according to the first embodiment of 
the present invention. The present image processing 
circuit 1 is applied to an imaging apparatus such as a 
video camera and a digital camera, various image 
processing apparatus, image transmission apparatus, 
the image processing in a personal computer, and the 
like for compressing the dynamic range of an input im- 
age X to output an output image Y. 
[0015] Incidentally, here, the input image X and the 
output image Y are two-dimensional digital images. 
Hereinafter, positions of a pixel in the horizontal direc- 
tion and the vertical direction are designated by marks 
the input image X and the output image Y are designat- 
ed by x(i, j) and y(i, j), respectively. Moreover, respective 
processed values corresponding to the pixel values x(i, 
j) and y(i, j) are similarly designated marks 1 
[0016] In the image processing circuit 1 , a non-linear 
smoothing unit 2 smoothes the pixel value x(i, j) of the 
input image X to be input into the non-linear smoothing 
unit 2 with a large dynamic range as shown in Fig. 5A, 
and outputs a smoothed image S based on a pixel value 
s(i, j) (shown in Fig. 5B). In the smoothing processing, 
the non-linear smoothing unit 2 performs the smoothing 
processing by judging whether each pixel value x(i,.j) is 
at an edge or not on the basis of the pixel value infor- 
mation and spatial information of the input image X, and 
thereby the non-linear smoothing unit 2 performs only 
the smoothing processing of components having small 
amplitudes and does not perform the smoothing 
processing of edge components which may have large 
amplitudes. Consequently, the non-linear smoothing 
unit 2 smoothes the pixel value x(i, j) of the input image 
X while preserving the edge to take out only the compo- 
nent determining the dynamic range of the image X sep- 
arately. 

[001 7] A look-up table (LUT) 3 outputs a gain correc- 
tion coefficient g(i, j) (shown in Fig. 5C) for correcting 
the pixel value x(i, j) of the input image X on the basis 
of the pixel value s(i, j) of the smoothed image S output 
from the non-linear smoothing unit 2. The image 
processing circuit 1 corrects the pixel value x(i, j) of the 
input image X with the gain correction coefficient g(i, j) 
to compress the dynamic range. The look-up table 3 out- 
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puts the gain correction coefficient g(i, j) in conformity 
of the input-output characteristic thereof having, for ex- 
ample, a monotonically decreasing characteristic 
shown in Fig. 6. Incidentally, in the input-output charac- 
teristic shown in Fig. 6, when the pixel value s(i, j) of the 
smoothed image S is smaller than a prescribed value 
si, the look-up table 3 outputs a gain correction coeffi- 
cient g(i : j) of value 1 .0. As the pixel value s(i, j) of the 
smoothed image S increases from the prescribed value 
si, the gain correction coefficient g(i, j) decreases expo- 
nentially to be a value g1 at the max value s max of the 
pixel value s(i, j). 

[0018] In accordance with such input-output charac- 
teristic, when the pixel value x(L j) of the input image X 
rises before and after an edge with small variations of 
the pixel value, for example, as shown in Fig. 5A, the 
pixel value s(i, j) of the smoothed image S in which the 
small variations of the pixel value are eliminated is ob- 
tained. Then, the look-up table 3 outputs the gain cor- 
rection coefficient g(i, j) {shown in Fig. 5C) that takes a 
smaller value when the pixel value s(i, j) takes a larger 
value. In this case, because the edge is preserved in the 
pixel value s(i, j) of the smoothed image S, the look-up 
table 3 outputs the gain correction coefficient g(i, j), the 
value of which rapidly varies at the edge part. 
[0019] A delay circuit 4 delays image data constituting 
the input image X for an amount of time necessary for 
processing of the image data at the non-linear smooth- 
ing unit 2 and the look-up table 3. Thereby, the delay 
circuit 4 outputs the pixel value x(i, j) of the input image 
X at the adjusted timing with respect to the gain correc- 
tion coefficient g(i. j) which is outputted from the look-up 
table 3. 

[0020] A multiplier 5 multiplies the pixel value x(i, j) of 
the input image X output from the delay circuit 4 by the 
gain correction coefficient g(i,j) for correcting the pixel 
value x(i, j) of the input image X by the gain correction 
coefficient g(i, j) to output a pixel value z(i, j) for an image 
Z. 

[0021] Now, because in the present embodiment the 
gain correction coefficient g(i, j) is set to be equal to a 
value one or less, the multiplier 5 outputs the image Z 
having the pixel value z(i, j) that has the compressed 
dynamic range of that of the input image X as shown in 
Fig. 5D. Furthermore, because the gain correction co- 
efficient g(i, j) having a value rapidly varying at the edge 
part owing to the smoothed image S : in which small var- 
iations are removed while the edge is preserved, is gen- 
erated, the multiplier 5 generates the image Z, having 
the pixel value z(i, j), in which small variations of the pixel 
value of the input image X are preserved at the parts 
other than the edge part and only the variation of the 
pixel value atthe edge part is compressed. That is, there 
is generated the image Z only the general dynamic 
range of which is selectively compressed. 
[0022] Thereby, the present embodiment outputs the 
image Z the dynamic range of which is compressed at 
a high compression rate while evading effectively the 



lowering of an impression of the contrast owing to the 
compression of the small variations of pixel values and 
the unnatural edge emphasis owing to the variation of 
the frequency characteristic of an image. 

5 [0023] A look-up table 6 finally sets characteristics of 
the image Z the dynamic range of which is compressed, 
and generates the output image Y. That is, an input-out- 
put characteristic of the look-up table 6 is set so as to 
compress gradations near to black and to white as 

10 shown in Fig. 7. Thereby, the look-up table 6 prevents 
saturation of gradation at a part of the dynamic range of 
the image data output from the multiplier 5 that exceeds 
the dynamic range of the output image Y, and can effec- 
tively evade a situation that gradations of the output im- 

15 age Y near to black and to white are lost. 

(1-2) NON-LINEAR SMOOTHING UNIT 

[0024] Fig. 8 is a block diagram showing a configura- 

20 tion of a non-linear smoothing unit 2. In the non-linear 
smoothing unit 2, a two-dimensional linear lowpass filter 
(LPF) is used as the lowpass filter 1 1 for smoothing the 
input image X. The generation of noise in a shape of a 
point at the following processing is prevented by the 

25 smoothing processing of the pixel value x(i, j) of the input 
image X in advance to some extent. Incidentally, by the 
use of one-dimensional linear lowpass filers in the hor- 
izontal direction and the vertical direction of the input 
image X severally as the lowpass filter 11, the similar 

30 processing can be performed. 

[0025] A look-up table 12 performs a logarithmic 
transformation of the pixel value of image data F1 output 
from the lowpass filter 11 so as to output the logarithmi- 
cally transformed data, and thereby the logarithmically 

35 transformed pixel value is smoothed in the following 
processing lest the degree of the smoothing differs with 
the pixel value. 

[0026] An improved e filter 13AX is a filter that has 
been changed a part of a non-linear smoothing filter 
40 called as an e filter. The improved e filter 1 3AX smoothes 
pixel values of the input image L1 input by the look-up 
table 12 while preserving edges in the horizontal direc- 
tion of the image L1 to output the smoothed pixel value. 
[0027] A successive improved e filter 13BX is a non- 
45 linear smoothing filter like the improved e filter 13AX, 
and smoothes the pixel value of the input image L2 input 
by the improved e filter 13AX while preserving edges in 
the horizontal direction of the image L2 to output the 
smoothed pixel value. The improved e filter 1 3BX has a 
50 delay time, which will be described later, different from 
that of the improved e filter 13AX, and thereby has a 
sampling pitch for the smoothing processing different 
from that of the improved e filter 13AX. The other fea- 
tures of the improved £ filter 1 3BX are the same as those 
5 5 of the improved e filter 1 3AX. 

[0028] The non-linear smoothing unit 2 has a pre- 
scribed number of stages of such improved e filters hav- 
ing a sampling pitch different from each other for the 
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smoothing processing in a serial connection disposition. 
Thereby, the non-linear smoothing unit 2 performs the 
smoothing processing for each frequency component of 
the pixel value corresponding to each sampling pitch, 
and thereby the non-linear smoothing unit 2 performs 
the sufficient smoothing processing over a substantially 
wide frequency range with respect to the total frequency 
band. 

[0029] Improved e filters 13AY, 13BY... are have the 
configuration similar to those of the improved e filters 
13AX, 13BX, except the point that the improved e fil- 
ters 13AY, 13BY, performs the smoothing processing 
in regard of the vertical direction. Accordingly, the im- 
proved e filter 13AY, which is the first stage of the im- 
proved e filter 13AY, 13BY, ... is configured so that the 
image data is changed in its arrangement by the use of 
a memory not shown in the figure and is input to the 
improved e filter 13AY. By the aforesaid configuration, 
the non-linear smoothing unit 2 performs the smoothing 
processing of the input image in its horizontal direction 
and its vertical direction over a wide frequency band 
while preserving the edge thereof. 
[0030] A look-up table 14 performs the inverse loga- 
rithmic transformation of the image date that was 
smoothed by the improved e filters 13AY, 13BY, .., con- 
versely to the look-up table 12, and outputs the trans- 
formed data. A lowpass filter 15 is a linear lowpass filter 
like the lowpass filter 11 , and slightly dulls the edge of 
the output image L3 output from the look-up table 14 
that was smoothed while preserving the edge. Thereby, 
a part in vicinity of the edge of the output image Y is 
smoothed so that occurrence of unnatural feeling result- 
ed by a series of the processing may be obstructed. 

(1-2-1) IMPROVED e FILTER 

[0031] Because the improved e filter 13AX is a filter 
that modified a part of the configuration of the general e 
filter, a configuration of the improved e filter 1 3AX will be 
described in contradistinction to an e filter in the follow- 
ing. Incidentally, because the configuration of the im- 
proved e filter 13BX, .. is the same as that of the im- 
proved e filter 13AX except that their sampling pitches 
for the smoothing processing differ from each other 
parts concerning the different configuration are suitably 
described here and a duplicate description is omitted. 
Moreover, the configurations of the improved e filters 
13AY, 13BY, .. are the same as those of the improved e 
filters 13AX, 13BX, except that an order of the image 
data to be processed is different, the duplicate descrip- 
tion is also omitted. 

[0032] An input-output characteristic of an ordinary 
one-dimensional e filter having 2N + 1 taps can be ex- 
pressed by equation 1 shown in Fig. 1, where s n indi- 
cates an output value; r n indicates an input value; e in- 
dicates a prescribed reference value; r n indicates the in- 
put value of the center of an object to be processed; and 
a k indicates a weighting coefficient. Moreover, a range 



of summation (sigma) in the second formula in the equa- 
tion 1 isfromk=-Ntok=N. 

[0033] Thereby, when the output value s n of a pixel p n 
having a pixel value r n is computed, as shown in Fig. 

5 9A, a weighting addition processing is performed as fol- 
lows: that it. as to the pixel p n . k at which the absolute 
value of the difference between the central pixel value 
r n and the pixel value of the pixel p^ r n - r n . k is larger 
than the reference value e among the pixels p 1 -p2 N+1 

10 being objects of the computation processing, the pixel 
value r n . k is replaced with the central pixel value r n . 
Moreover, as to the pixel p n . k at which the absolute value 
of the difference of the pixel values r n - r„. k is equal to 
or less than the reference value e, the pixel value r n _ k 

15 of the pixel Pn_ k is used. 

[0034] That is, as shown in Fig. 9A, when the output 
value s n of a pixel P n is computed by the e filter, the value 
s n is computed by the replacement of the pixel value r m 
of a pixel p m at which the pixel value r m differs from that 

20 of the pixel P n in an extent larger than the reference val- 
ue e as the judgment reference among the before and 
the behind of the pixel P n with the pixel value r n . There- 
by, as shown in Fig. 9B, the small variations of the pixel 
values are suppressed while the edge is preserved in 

25 comparison with the processing of a plain linear lowpass 
filter. 

[0035] However, in this method, because the pixel val- 
ue is judged on the basis of the reference value e with 
the value r n of the pixel P n the output value of which is 

30 computed as the center, and then the output value s n is 
computed by the weighting addition by means of the re- 
placement of the pixel value with the pixel value r n of the 
pixel P n . Accordingly, the small variations of the pixel 
value can be suppressed while the edge is preserved 

35 when the pixel value x varies at almost constant direct 
current level like both the sides of the edge shown in 
Fig. 9A. However, it becomes difficult to smooth the pixel 
value sufficiently when the direct current level varies as 
shown in Fig. 10. 

40 [0036] That is, when a direct current level of an input 
value r increases or decreases gradually, the more a pix- 
el becomes distant from the pixel P n at which output val- 
ue s n is computed, the less the number of the pixels in- 
cluded in a region set on the reference value e becomes. 

45 Moreover, in this case, even if the weighting addition by 
the replacement of the value r n of the pixel P n , the 
smoothing processing may not be performed on the re- 
flection of the variations of the direct current level cor- 
rectly. 

50 [0037] Accordingly, in the present embodiment, as 
shown by the following equation in contradistinction to 
the equation 1 shown in Fig. 1 , the variation of the direct 
current level is approximated by a certain function, and 
a region (2e1 ) is set by means of the function around the 

55 pixel value r n of the pixel P n for the judgment of a pixel 
value. Moreover, as for a pixel out of the region, the pixel 
value is replaced with a pixel value on the function for 
performing the smoothing processing. Incidentally, 
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here, a range of the sigma in the second formula in 
equation 2 shown in Fig. 2 is k = -N to k = N, and a range 
of the sigma of the second formula in equation 3 is s = 
-M to s = M - 1 . 

[0038] Here, the linearfunction is applied as the afore- 
said function, and the variations of the direct current lev- 
el are processed by linear approximation. That is, an av- 
eraged value K a of the inclinations of straight lines con- 
necting adjoining pixels among 2M pixels before and be- 
hind a pixel at which the output value s n is computed. 
And then, a region is set on the basis of the averaged 
value ^ of the inclinations to judge a pixel value, and 
further pixel values are replaced to be situated on the 
straight line. Thereby, the present embodiment can per- 
form the smoothing processing while preserving the 
edge with much better reliability in comparison with the 
prior art. Incidentally, a case where the average value 
K a of the improved e filter is set to zero is the character- 
istic of a general £ filter described with regard to Fig. 9. 
[0039] Fig. 11 is a block diagram showing the im- 
proved e filter 13AX. In the improved e filter 13AX, a pixel 
value rto be smoothed is input in turn into delay circuits 
(D) 21 A-21 F having a prescribed delay time, and the im- 
proved e filter in this example is configured to have sev- 
en taps. Now, the delay circuits 21 A-21 F are constituted 
of a prescribed number of stages (m stages) of registers 
22A-22N connected in series as shown in Fig. 12. Here- 
by, the improved e filter 13AX can select seven samples 
of the pixel value r(i, j) at the sampling pitch correspond- 
ing to the number of stages of the register train 22A-22N 
(namely, corresponding to the delay times of the delay 
circuits 21 A-21 F). 

[0040] The improved e filter 13AX performs its 
processing by selecting pixel value r according to the 
sampling pitch corresponding to the number of stages 
of the registers 22A-22N, and thereby the improved e 
filter 13AX performs its smoothing processing by using 
a wide extent of pixel values to that degree before and 
behind the pixel the output value of which is to be com- 
puted. Thereby, the processing at the following stages 
is simplified correspondingly to the wide extent. Inciden- 
tally, if the smoothing processing is performed by the 
use of pixel values in such a wide extent the variations 
of the pixel values owing to the low frequencies can be 
sufficiently suppressed to that degree. 
[0041] Incidentally, the improved e filter 13BX, .. are 
configured to have registers the number of stages of 
which is different from that of the improved e filter 1 3AX : 
and are configured so that the deiay times of the corre- 
sponding delay circuits 21 A-21 F are different from those 
of the improved e filter 13AX. Thereby, the improved e 
filter 13BX, .. are configured to perform their smoothing 
processing in accordance with the frequency character- 
istics different from those of the improved e filter 13AX. 
[0042] To the inclination computing circuit 24 (shown 
in Fig. 11), a pixel value input into the first stage delay 
circuit 21 A is input together with the output values from 
the delay circuits 21 A-21 F, and then seven sampled r(i, 



j) corresponding to the delay times of the delay circuits 
21 A-21 F are input. An inclination computing circuit 24 
executes a computation processing of equation 3 shown 
in Fig. 3 to compute the averaged value K a of the incli- 

5 nation for outputting it. 

[0043] Arithmetic operation circuits 25A-25F perform 
computation processing of the third formula and the 
fourth formula in the equation 2 shown in Fig. 2 with re- 
gard to the outputs of each tap rn _ 3mj r n _ 2m , r^ m: r n+m , 

10 r n+2m» r n+3m among pixel values at the seven tap output 
from the delay circuits 21 A-21 F except the output value 
r n of the center tap, respectively, and output the process- 
ing results w n . 3m , w n . 2m , w n . m , Wf>+mj w n+2m , w^, re- 
spectively. Incidentally, here, m indicates the number of 

is stages of the registers in the delay circuits 21 A-21 F. 
[0044] That is, in the arithmetic operation circuit 25 A 
(25B-25F), as shown in Fig. 13 : the averaged value K a 
of the inclination is input to a multiplier 28, and the mul- 
tiplier 28 multiplies the input average value K a by the 

20 distance k from the center tap corresponding to each 
tap output r^.r^, 

r n-rn> r rH-m> r n+2m> r n+3m» severally, 

and thereby the deviation K a - k at the sampling point of 
each tap output r^ Zm> r n _ 2m , rfVm , r n+m , r n+2m , r^ from 
the center tap output r n is computed in accordance with 
25 the linear function of the average value K a of the incli- 
nations (see equations 2 and 3). 

[0045] A subtracter 29 computes the V n . k in the equa- 
tion 2 by subtracting the output value K a - k of the mul- 
tiplier 28 from each tap r^ 3m , r n . 2m , r^, r^, r n+2m> 
30 r n+ 3m to 0U tPUt it. 

[0046] A subtracter 30 computes the (r n - v^) in the 
equation 2 by subtracting the output value v^ of the 
subtracter 29 from the center tap output r n , and output 
the result. 

35 [0047] The absolute value circuit 31 computes the r n 
-v n _ k in the equation 2 by taking the absolute value of 
the output value (r n - v n . k ) of the subtracter 30, and out- 
puts the results. 

[0048] A comparator (CMP) 32 performs a largeness 
40 judgment processing in the equation 2 by comparing the 
output value r n -V n . k of an absolute value circuit 31 with 
the reference value e1 for the region setting mentioned 
above with regard to Fig. 10, and outputs the judgment 
result in term of a switching signal for a selector (SEL) 

45 33. 

[0049] An adder 34 computes the r n + K a • k in the 
equation 2 by adding the center tap output r n and the 
output value K a • k of the multiplier 28, and outputs the 
results. 

so [0050] The selector 33 selectively outputs each tap 
output r^, rn _ 2mi r^, r n+m: r n+2m , r n+3m or the output 
value r n + K a • k of the adder 34 in accordance with the 
switching signals SEL output from the comparator 32. 
[0051] By the aforesaid configuration, the arithmetic 

55 operation circuit 25A adjusts a linear function of the in- 
clination computed by the inclination computing circuit 
24 so as to pass the position of the pixel value r n of the 
pixel P n at which the output value is computed, and sets 
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a region having a value e1 on the upper and lower sides 
of the disposed straight line. Then, a pixel the pixel value 
of which protrudes from the region is judged to be the 
edge and the pixel value is replaced with a pixel value 
on the straight line, and as to a pixel in the region, the 
computing result based on the original pixel value of the 
pixel is output. 

[0052] Weighting circuits 36A-36G shown in Fig. 11 
perform weighting processing of the output values from 
the arithmetic operation circuits 25A-25F or the output 
value from the center tap by the use of weighting coef- 
ficients corresponding to each tap and output the re- 
sults . respectively, and thereby executes the computa- 
tion processing of each term of the sigma in the first for- 
mula in the equation 2. 

[0053] An adder 37 adds the output values from these 
weighting circuits 36A-36G, and thereby executes the 
computation processing of the first formula in the equa- 
tion 2, and outputs the processing result. 

(1-2-2) LOOKUP TABLE 3 

[0054] Now, Fig. 14 is a characteristic curve diagram 
showing the gradation conversion characteristic of a low 
frequency component of the image processing circuit 1 . 
The input-output characteristic of the lookup table 3 is 
set by the gradation conversion characteristic shown in 
Fig. 14. 

[0055] That is, when a pixel value s max that is the larg- 
est value in the low frequency component is input into 
the image processing circuit 1 , the corresponding output 
value is set to s cmp in accordance with a characteristic 
curve designated by mark L2. In this case, the compres- 
sion rate g1 of the dynamic range is expressed by s cmp / 
s max . As shown by the characteristic curve designated 
by the mark L2, in an extent up to the pixel value si of 
the low frequency component, output values generated 
from input values by a gain of one are output. Inciden- 
tally, the pixel value s1 is smaller than the upper limit of 
the dynamic range of the output image, and the pixel 
values having values equal to or smaller than the value 
s1 in the input image X are considered as not necessary 
to compress the gradation of the pixel value. 
[0056] The look-up table 3 divides each value on the 
ordinate axis by the conversion characteristic curve hav- 
ing a gain one and being designated by the mark L1 that 
is the conversion characteristic curve up to the pixel val- 
ue s1, and the input-output characteristic is set by the 
operation expressed by L2/L1 . 

(2) OPERATION OF FIRST EMBODIMENT 

[0057] In the aforesaid configuration, in the image 
processing circuit 1 (Fig. 4), the input image X, which is 
an photographed result or the like, is input into the non- 
linear smoothing unit 2 (Fig. 5A and Fig. 5B), and the 
input image X is processed to be smoothed while the 
edge thereof is preserved by the non-linear smoothing 



unit 2, and thereby the smoothed image S is generated. 
Because the smoothed image S is here processed to be 
smoothed while the edge thereof is preserved, the com- 
ponents that determine the contrast of the object and 
5 are desired to be preserved without being compressed 
and further are independent of the dynamic range of the 
image are removed, and only the components that de- 
termines the dynamic range of the image is separately 
taken out. 

10 [0058] In the image processing circuit 1, by the access 
of the look-up table 3 by means of the smoothed image 
S, the gain correction coefficients g(L j) are generated 
in sequence (Fig. 5C and Fig. 6), and the pixel value x 
(i, j) of the input image X input through the delay circuit 

i* 4 is multiplied by the multiplier 5 to compress the dy- 
namic range of the input image X (Fig. 5D). At this time, 
the pixel value x(i, j) of the input image X is corrected 
by the gain correction coefficient g(i, j) of the smoothed 
image S being only the component to determine the dy- 

20 namic range of the image, and consequently, only the 
variations of the pixel value as the whole are selectively 
compressed and generated while the localized varia- 
tions of the pixel value and the edge of the image are 
preserved. Thereby, the image Z in which the deteriora- 

25 tion of the contrast feeling that is a contrast to look at is 
evaded and the dynamic range thereof is fully com- 
pressed is generated. Moreover, as for the edge, the 
change of the frequency characteristic is also prevent- 
ed, and thereby the unnatural emphasis of the edge is 

30 prevented. 

[0059] In the image processing circuit 1 • by the access 
to the look-up table 6 by the pixel value of the image Z 
the dynamic range of which was thus compressed (Fig. 
4 and Fig. 7), the gradations in the vicinity of black and 

35 white are selectively compressed, and thereby output 
image Y is output while evading effectively the situation 
in which the gradations in the vicinity of black and white 
are lost even if the input image X having an extremely 
large dynamic range is input. 

40 [0060] Accordingly, for example, an imaging appara- 
tus such as a video camera and an electronic still cam- 
era using the image processing circuit 1 may enable to 
prevent deterioration in the quality of the imaged result 
by performing the recording and the reproducing of the 

45 imaged results with its recording and reproducing sys- 
tem having a narrower dynamic range than that of the 
imaged result. Incidentally, in the imaging apparatus, 
such an imaged result wider in the dynamic range than 
an ordinal case may be obtained by the selection of the 

50 image pickup device, the synthesis of the image data 
with different sensitivity and so on. Moreover, when an 
image data having such a wider dynamic range is dis- 
played by the application to an image displaying appa- 
ratus in accordance with the present embodiment, a 

55 high quality image may be displayed. 

[0061] Moreover, even if an image having a wide dy- 
namic range is variously processed by the application 
of the image processing circuit 1 to the image correction 



7 



13 



EP1 137 258 A2 



14 



such as the backlight correction, and the image synthe- 
sis and the image processing using a computer, the re- 
sult of the processing can be transmitted, recorded and 
reproduced without the deterioration of the quality of the 
image. Thereby, such various processing can also be 
performed in high quality. Moreover, when the image 
processing apparatus is applied to an image transmis- 
sion apparatus, an image can be transmitted at a high 
speed with the effective evasion of the deterioration of 
image quality. 

[0062] When the image processing circuit smoothing 
a pixel value while preserving the edge component, the 
non-linear smoothing unit 2 (shown in Fig. 8) of the im- 
age processing circuit 1 limits a band width of the pixel 
value x(i, j) of the input image X with the lowpass filter 
1 1 , and then performs the smoothing processing while 
preserving the edge of the input image X with the im- 
proved e filters 13AX, .., and consequently the genera- 
tion of noise in a shape of a point in an output image Y 
may be prevented. 

[0063] Moreover, by setting a band limitation in the 
smoothed image S at the last stage low pass filter of the 
non-linear smoothing unit 2 : the unnatural variations of 
a pixel value near to the edge may be lowered, and 
thereby there may be obtained an output image Y in 
which the vicinity of its edge is expressed smoothly 
[0064] Moreover, after the logarithmic transformation 
of the pixel value x(i, j) by the look-up table 12 and the 
execution of the smoothing processing while preserving 
the edge, the smoothed image S is generated by the 
inverse logarithmic transformation by the look-up table 
14, and thereby mutual differences between the 
smoothing processing results in the pixel values may be 
prevented, and the unnatural compression of the dy- 
namic range of the output image Y may be prevented. 
[0065] Moreover, the filtering processing of the input 
image that suppresses the high frequency components 
thereof while preserving the edge thereof is successive- 
ly performed by the improved e filters 13AX, 13BX, in 
the horizontal direction, and then the similar processing 
is performed by the successive improved e filters 13AY. 
13BY, .. in the vertical direction. Thereby, it becomes 
possible to generate the output image Y that secures a 
sufficient contrast feeling in the vertical direction, the 
horizontal direction and further oblique directions, and 
prevents the unnaturalness of the edge. 
[0066] Moreover, the improved e filters 13AX : 
13BX, .., 13AY, 13BY, .. perform the filtering processing : 
in which the edge is preserved in each direction, repeat- 
edly at different sampling pitches, and thereby the im- 
age processing circuit 1 can generate the smoothed im- 
age S that is sufficiently smoothed in a wide frequency 
band while the edge information thereof is preserved. 
Consequently, the image processing circuit 1 can exe- 
cute the smoothing processing so that only a specific 
frequency component is selectively left in such a 
smoothed image S, and the deterioration of the image 
quality of the output image Y can effectively be evaded 



in that degree. 

[0067] In each improved £ filter 13AX, 13BX, ... 13AY, 
13BY, .. (Fig. 10 and Fig. 11), the pixel value r is input 
in sequence into the delay circuits 21 A-21 F connected 

5 to each other in series, each tap output value other than 
the center tap output is judged by the arithmetic opera- 
tion circuits 25A-25F severally on the basis of the center 
tap output among the seven tap outputs from the delay 
circuits 21 A-21 F (Fig. 13). Moreover, when a pixel value 

10 greatly differs from the center tap output, the pixel value 
is judged to cross over an edge, the pixel value different 
greatly is replaced with a prescribed value. Thus the 
weighting addition of the center tap output and the other 
tap outputs is performed by the weighting circuits 36A- 

15 36F and the adder 37 whereby performing the smooth- 
ing processing. 

[0068] in the processing, because in each improved 
efilter13AX, 13BX, .., 13AY, 13BY, ...each delay circuit 
21 A-21 F is configured by a serial circuit of the registers 

20 22A-22N, the smoothing processing is executed by the 
sampling of the continuous pixel values at a pitch of the 
number of the registers connected in series. According- 
ly, the smoothing processing can be executed by ar- 
ranging the number of the arithmetic operation circuits 

25 25A-25F, the weighting circuits 36A-36F and the adder 
37 correspondingly to the tap outputs, and thereby the 
whole configuration thereof can be simplified in that de- 
gree. Moreover, as to the pixel value that is an object of 
the smoothing processing, the smoothing processing 

30 can be performed by the use of the pixel values in a wid- 
er extent in comparison with the configurations of the 
arithmetic operation circuits 25A-25F, the weighting cir- 
cuits 36A-36F, and the adder 37, and thereby, for exam- 
ple, pulsing variations having a low frequency can suf- 

35 ficiently be smoothed. 

[0069] Because in the image processing circuit 1 , 
each improved e filter 13AX, 13BX, .., 13AY, 13BY, .. is 
designed so that the number of stages of the resisters 
22A-22N constituting the delay circuits 21 A-21 F differs 

40 from each other, as mentioned above, the filtering 
processing is repeatedly executed at different sampling 
pitches, and consequently, the deterioration of the Im- 
age quality of the output image Y can be prevented. 
[0070] In such processing of replacing the pixel value 

45 by performing the edge judgment based on the center 
tap output, in each improved e filter 13AX, 13BX, .., 
13AY, 13BY, .., the low frequency component of each 
tap output is approximated to a prescribed function, and 
a region (2e1) is set by the function on the basis of the 

50 center tap output (Fig. 1 0), and then the edge is judged 
whether the pixel value belongs to the region or not. 
Thereby, each improved e filter 13AX, 13BX, .., 13AY, 
13BY, .. can judge the edge similarly in a case where 
the pixel values have no increase or decrease inclina- 

55 tion even if the pixel values have the gradual increase 
inclination or the gradual decrease inclination. Conse- 
quently, the deterioration of the output image Y owing 
to the variation of such judgment can be prevented. 
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[0071] Moreover, in a case where a pixel value is re- 
placed by the judgment of that the pixel is at the edge 
part, the pixel value to be replaced is determined on the 
basis of the function obtained in such a way. According- 
ly, the variations of the pixel value at such a low frequen- 
cy are reflected to the weighting processing, and thus it 
becomes possible to make the output image having far 
high quality. 

[0072] Moreover, in the present embodiment, a series 
of processing can be executed by the simple configura- 
tion such that a straight line inclination is obtains by the 
application of the linear function as the function, and fur- 
ther that the processing of the judgment and so on are 
executed by using the straight line inclination obtained. 
[0073] That is, in each improved e filter 13AX, 
13BX, ... 13AY, 13BY, .., the inclination computing circuit 
24. computes differential values between adjoining tap 
outputs among the seven tap outputs, and computes the 
averaged value K a of the inclination from the averaged 
value of the differential values. Moreover, in each arith- 
metic operation circuit 25A-25F, at the sampling posi- 
tions of tap outputs other than the center tap, the differ- 
ential value K a • k from the center tap output at the in- 
clination is computed by the multiplier 2B on the basis 
of the averaged value K a of the inclination and the dis- 
tance k from the center tap position. And then, the suc- 
cessive subtracters 29, 30 compute the differential val- 
ue between the pixel value on the function of the incli- 
nation K a and the actual pixel value of the tap output 
and the comparator 32 judges whether the differential 
value is larger than the reference value e1 or not. The 
judgment processing to judge whether or not the pixel 
is an edge by using an approximate function comprising 
the linear function is consequently executed. 
[0074] Furthermore, on the other hand, the adder 34 
computes the pixel value on the function of the inclina- 
tion K a , and any one of the actual tap output and the 
pixel value on the function that was thus computed is 
selected to be output according to the judgment result 
by the comparator 32. Consequently, the pixel value of 
the pixel crossing the edge is replaced with the pixel val- 
ue computed by using the approximate function com- 
prising the linear function, and then each tap output is 
output to the corresponding weighting circuit. 
[0075] Accordingly, as to the input image X having 
various image qualities in wide dynamic ranges, the im- 
age processing circuit 1 can compress the dynamic 
range sufficiently while preventing the deterioration of 
the edge and the lowering of the contrast sense. 

(3) EFFECT OF FIRST EMBODIMENT 

[0076] According to the aforesaid embodiment, the in- 
put image X is smoothed while the edge thereof is pre- 
served, and the gain correction coefficient g is obtained 
to correct the pixel value of the input image by means 
of the obtained gain correction coefficient g. Conse- 
quently, the dynamic range of the image can be com- 



pressed at a higher compression rate while the lowering 
of an impression concerning the contrast and the unnat- 
ural edge emphasis of the input image are effectively 
evaded. 

5 [0077] Moreover, after the dynamic range was thus 
compressed, further the gradation is corrected by the 
look-up table 6, and thereby the loss of the gradation in 
the vicinity of black and in the vicinity of white can effec- 
tively be evaded, 

10 [0078] Moreover, when the input image X is thus 
smoothed while the edge thereof is preserved, after the 
band limitation with the lowpass filter, the processing of 
the logarithmic transformation is performed. Moreover, 
the inverse logarithmic transformation of the result of the 

is logarithmic transformation processing is performed, and 
thereby the generation of noise in a shape of a point is 
prevented, and further the mutual differences between 
the smoothing processing results in pixel values can be 
prevented. 

20 [0079] Moreover, when the input image X is smoothed 
while the edge thereof is preserved, a plurality of filtering 
processing with the sampling pitches which are different 
from each others are repeated, and then an uniform 
smoothing processing in the wide frequency band can 

25 be performed. Accordingly, the output image Y having 
high quality can be output. 

[0080] Moreover, by performing the smoothing 
processing by the sampling of a continuing pixels at a 
prescribed pitch, the smoothing processing of a wide ex- 

30 tent pixel values can be executed with a simple config- 
uration, and thereby the smoothing processing for a low 
frequency is also fully performed to make it possible to 
obtain a high quality output image Y. 
[0081] Moreover, by the approximation of a function 

35 in accordance with the pixel values to set a region on 
the basis of the function for the judgment of the edge in 
the smoothing processing, and further by the computa- 
tion of the pixel value to be replaced by means of the 
function, a high quality output image Y can be obtained. 

40 [0082] Furthermore, by using a linear function for the 
function, the configuration as a whole may be simplified. 

(4) SECOND EMBODIMENT 

45 [0083] Fig. 15 is a block diagram showing an image 
processing circuit according to a second embodiment of 
the present invention in comparison with the first em- 
bodiment shown in Fig. 4. In the image processing cir- 
cuit 41 , the identical constitutional components to those 

so of the image processing circuit 1 are designated by cor- 
responding marks, and the overlapping description of 
them is omitted. 

[0084] The image processing circuit 41, like the image 
processing circuit 1, as shown in Figs. 16A-16F, 
55 smoothes the input image X (Fig. 1 6A) constituted of the 
pixel value x(i ; j) to generate a smoothed image S (Fig. 
1 6B), and compress the dynamic range of the input im- 
age X by the gain correction coefficient g(i, j) (Fig. 16C) 
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generated by the pixel value s(i, j) of the smoothed im- 
age S. In the processing, the image processing circuit 
41 emphasizes the variations of the pixel value y(i, j) of 
the output image Y by using the subtraction value x(i, j) 
- s(i, j) which is obtained by subtracting the output value 
s(i, j) in the smoothing processing from the pixel value 
x(i, j) of the input image X. 

[0085] That is, in the image processing circuit 41 , the 
subtracter 42, the multiplier 43, the adder 44 are ar- 
ranged in order between the delay circuit 4 and the mul- 
tipliers. Here, the subtracter 42 subtracts the output val- 
ue s(i, j) by the smoothing processing from the pixel val- 
ue x(i, j) of the input image X to output the subtracted 
value x(i, j) -s(i, j) (Fig. 16D). The next multiplier 43 am- 
plifies the subtracted value x(i, j)-s(i, j) by a prescribed 
gain K (Fig. 16E) ; and the adder 44 adds the pixel value 
s(i, j) of the smoothed image S to the output value of the 
multiplier 43. Thus, the image processing circuit 41 mul- 
tiplies the result of the addition of the adder 44 : that em- 
phasizes small pulsing variations to be eliminated by the 
non-linear smoothing unit 2 in comparison with the input 
image X, with the multiplier 5 to generate the output im- 
age Y. Consequently, the image processing circuit 41 is 
configured so as to output the so-called sharper image 
in comparison with the image processing circuit 1 de- 
scribed above with regard to Fig. 4 to the extent that 
such small pulsing variations are emphasized. 
[0086] According to the configuration shown in Fig. 
1 5, by the emphasis of the variations of the pixel values 
y(i, j) by the use of the subtracted value x(i, j) - s(i, j) 
obtained by the subtraction of the output value s(l, j) in 
the smoothing processing from the pixel value x(i, j) of 
the input image X, further sharper image can be output 
in addition to the effects of the first embodiment. 

(5) THIRD EMBODIMENT 

[0087] Fig. 17 is a block diagram showing an image 
processing circuit 51 in accordance with a third embod- 
iment of the present invention in comparison with the 
embodiment shown in Fig. 15. In the image processing 
circuit 51, the identical constitutional components to 
those of the image processing circuit 41 are designated . 
by reference marks corresponding to those of the image 
processing circuit 41 , and the overlapping description is 
omitted. 

[0088] The image processing circuit 51 sets the gain 
of the multiplier 43 by accessing a look-up table 52 by 
the output value s(i, j) of the smoothed image S. Here, 
the input-output characteristic of the look-up table 52 is 
set as shown in Fig. 18. Hereby, the look-up table 52 
sets the gain of the multiplier 43 at a constant gain when 
the output value s(i, j) is equal to a prescribed value or 
less, and sets the gain so as to approach gradually to 
the value one when the output value s(i, j) increases to 
be equal to the prescribed value or more. 
[0089] Thereby, the image processing circuit 51 is 
configured so as to decrease the extent of the emphasis 



of contrast in a region where the pixel value has a large 
value. That is, there are many cases where the contrast 
is also sufficiently large at the vicinity of a pixel having 
a large pixel value in general images. Accordingly, if the 

5 contrast is uniformly emphasized, the contrast is em- 
phasized more than the extent to be needed in the vi- 
cinity of such a pixel, and the output image is observed 
to be inferior in its quality by that extent in the results of 
the processing. However, if the degree of the emphasis 

10 of the contrast in the region where the pixel values are 
large is decreased like the present embodiment, the im- 
age with natural high quality can be output as a whole. 
[0090] According to the configuration shown in Fig. 
1 7, by varying the degree of emphasizing in accordance 

is with the pixel value, the image with the far higher quality 
can be output. 

(6) FOURTH EMBODIMENT 

20 [0091] Fig, 1 9 is a block diagram showing an image 
processing circuit according to a fourth embodiment of 
the present invention in comparison with the embodi- 
ment shown in Fig. 15. 

[0092] The image processing circuit 61 , as shown in 

25 Fig. 19, eliminates noises of the input image X in ad- 
vance with a noise elimination filter 62, and then enlarg- 
es the dynamic range of the input image X by the mul- 
tiplication of a uniform gain with the successive multipli- 
er 63 (Fig. 20A and Fig. 20B). After the multiplication 

30 processing, the image processing circuit 61 compress- 
es the dynamic range with the image processing circuit 
1 to the original dynamic range of the input image X, and 
output the processing results (Fig. 20C). 
[0093] Here, as for the noise elimination filter 62, gen- 

35 eral coring processing : a median filter, an e filter or an 
improved e filter is applied. Moreover, in the present em- 
bodiment, the image processing circuit 1 corrects a pixel 
value at a fixed gain to the pixels having a pixel value 
larger than a prescribed pixel value, and corrects a pixel 

40 value so that the gain increases to the pixels having a 
pixel value equal to the prescribed pixel value or less 
contrary to the characteristic mentioned above about 
Fig. 6. 

[0094] According to the configuration shown in Fig. 

45 19, the processing such as the correction of gradation 
can be executed with evading the deterioration of the 
image quality effectively of the image having extremely 
high contrasts such as back-lighted image. 
[0095] That is, in the image processing circuits men- 

so tioned above by reference to Fig. 4 and so forth, by the 
correction of the pixel value in accordance with the char- 
acteristic of monotonous decrease as shown in Fig. 6, 
the dynamic range of an input image X is compressed 
by lowering the brightness in only the light part of the 

55 input image X without lowering the brightness in the dark 
part of the input image X. However, by the present em- 
bodiment, the whole contrast can be compressed by 
raising the brightness only in the dark part of the input 
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image X while the brightness of the part having the mod- 
erate light of the input image X is compressed not to 
become brighter than the present brightness by com- 
pressing the dynamic range of the input image X in ac- 
cordance with the characteristic contrary to the charac- 
teristic shown in Fig. 6. The processing such as the 
back-lighted correction can be thereby accomplished. 

(7) FIFTH EMBODIMENT 

[0096] Fig. 21 is a block diagram showing an image 
processing circuit 71 in accordance with a fifth embod- 
iment of the present invention. In the image processing 
circuit 71 , the matrix circuit 72 performs the computation 
processing of color signals R, G and B of red, blue and 
green, respectively, to generate a luminance signal Y 
and color difference signals R-Y, B-Y. 
[0097] The image processing circuit 1 compresses 
the dynamic range of the luminance signal Y by process- 
ing the luminance signal Y selectively and outputs the 
processing results. By compressing only the luminance 
signal Y selectively by the image processing circuit 1. 
the image processing circuit 71 prevents the change of 
the ratios of signal levels among the color signals R, B 
and G of red, blue and green, and thereby prevents the 
change of hue owing to the change of the ratios. 
[0098] The dividers 73 and 74 normalize the color dif- 
ference signals R-Y, B-Y by the luminance signal Y by 
dividing the color difference signals R-Y, B-Y by the lu- 
minance signal Y severally. The delay circuits 77 and 78 
delay the color difference signals R-Y, B-Y output from 
the dividers 73 and 74 for an amount of the processing 
time with the image processing circuit 1 to output them. 
The multipliers 77 and 78 correct the pixel value of the 
color difference signal normalized with the dividers 73 
and 74 by multiplying the luminance signal Y output from 
the image processing circuit 1 by the color difference 
signals R-Y, B-Y output from the delay circuits 77 and 
78, respectively. 

[0099] That is, even if only the dynamic range of the 
luminance signal is compressed, because the color dif- 
ference signals are difference signals between the lumi- 
nance signal and a color signal, the ratio of the compo- 
nent of saturation is raised at the corresponding lumi- 
nance level when no correction of the signal level of the 
color difference signals is performed. In the end, the sat- 
uration becomes high when the image is seen as a 
whole. 

[01 00] Accordingly, the image processing circuit in ac- 
cordance with the present embodiment normalizes the 
color difference signal components with the luminance 
signal component in advance to compress the dynamic 
range of the luminance signal component. Afterthat, the 
image processing circuit in accordance with the present 
embodiment corrects the pixel value of the color differ- 
ence signal components normalized by the pixel value 
of the luminance signal component. Thereby, the em- 
bodiment preferably compresses the dynamic range of 



the color image signals by preventing the change in a 
color saturation. 

(8) OTHER EMBODIMENTS 

5 

[0101] Incidentally, in the aforesaid embodiments, a 
case where an edge is judged by the approximation 
comprising a linear function and a pixel value is replaced 
in the improved £ filter is described. However, the 

10 present invention is not limited to such a case only. For 
example, by the approximation of a quadratic function 
or the like, these processing may be performed. 
[0102] Moreover, in the aforesaid embodiments, a 
case where an edge is judged by the approximation by 

'5 means of a function and the pixel value is replaced in 
the improved e filter is described. However, the present 
invention is not limited to the case. The approximation 
by a function may be used only for the judgment of an 
edge or only for the replacement of a pixel value. 

20 [0103] Moreover, in the aforesaid embodiments, a 
case where continuing pixel values are sampled at a 
prescribed sampling pitch to process them in the im- 
proved e filter is described. However, the present inven- 
tion is not limited the case. All the continuing pixels may 

25 be used to process if a circuit with a sufficient capability 
is available in practice or the like. 
[0104] Moreover, in the aforesaid embodiments, a 
case where the input image is smoothed by repetition 
of the smoothing processing of the improved e filter is 

30 described. However, the present invention is not limited 
to the case. The repetition processing may be omitted 
if practically sufficient characteristic can be obtained in 
other way. 

[0105] Moreover, in the aforesaid embodiments, a 
35 case where the non-linear smoothing unit is configured 
by the improved e filter is described. However, the 
present invention is not limited to the case. Alternatively, 
the non-linear smoothing unit may be configured using 
a usual e filter. 

40 [0106] Moreover, in the aforesaid embodiments, a 
case where the input-output characteristic is finally cor- 
rected with the look-up table 6 is described. However, 
the present invention is not limited to the case. The 
processing using the look-up table 6 may be omitted, or 

45 the look-up table 3 may also be used for correcting the 
characteristic. 

[0107] Moreover, in the aforesaid embodiments, a 
case where the image processing circuit is configured 
so as to process pixel values at each circuit block is de- 

50 scribed. However, the present invention is not limited to 
the case. The whole or a part of the circuits may be used 
to process with the computation processing. 
[0108] According to the present invention, a gain cor- 
rection coefficient is obtained by smoothing an input im- 

55 age while preserving the edge of the input image, and 
corrects the pixel number of an input image by means 
of the obtained gain correction coefficient, and thereby 
the present invention effectively avoids the lowering of 
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an impression concerning the contrast and the unnatu- 
ral edge emphasis of the input image and makes it pos- 
sible to compress the dynamic range of the input image 
in a higher compression rate. 

[0109] Although the invention has been described in 5 
its preferred form with a certain degree of particularity, 
obviously many changes and variations are possible 
therein. It is therefore to be understood that the present 
invention may be practiced than as specifically de- 
scribed herein without departing from scope and the 10 
sprit thereof. 



Claims 

15 

1. An image processing circuit compressing a dynam- 
ic range of an input image, said circuit comprising: 

smoothing processing means smoothing a pix- 
el value of the input image while preserving an 20 
edge of the input image; 
correction coefficient generation means gener- 
ating a gain correction coefficient according to 
an output value of said smoothing processing 
means; and 25 
pixel value correction means correcting said 
pixel value of the input image on a basis of said 
gain correction coefficient. 

2. A method for processing an image to compress a 30 
dynamic range of an input image, said method com- 
prising the steps of: 

smoothing a pixel value of the input image while 
preserving an edge of the input image; 35 
generating a gain correction coefficient in ac- 
cordance with an output value at said smooth- 
ing step; and 

correcting said pixel value of the input image 

on a basis of said gain correction coefficient. 40 

3. The method according to claim 2, said method fur- 
ther comprising the step of: 

correcting a gradation of said pixel value cor- 
rected at said step of correcting said pixel value. 45 

4. The method according to claim 2, said method fur- 
ther comprising the step of: 

emphasizing a variation of said pixel value to 
be corrected at said step of correcting said pixel val- so 
ue by using a subtracted value obtained by sub- 
tracting an output value at said step of smoothing 
from said pixel value of the input image. 

5. The method according to claim 2, said method fur- 55 
ther comprising the steps of: 

eliminating noises of the input image before- 



hand; and 

enlarging said dynamic range of the input im- 
age by multiplying said pixel value of the input 
image after said step of eliminating noise by a 
uniform gain to provide said pixel value to said 
steps of smoothing and correcting said pixel 
value. 

6. The method according to claim 2, wherein said step 
of smoothing includes the steps of: 

filtering a low frequency component from the in- 
put image; 

performing a logarithmic transformation of said 
pixel value after said step of filtering; 
performing nonlinear filtering to suppress a 
high frequency component of the image while 
preserving an edge of the image after said step 
of logarithmic transformation; and 
performing an inverse logarithmic transforma- 
tion of said pixel value after said step of nonlin- 
ear filtering. 

7. The method according to claim 6, wherein, 

said step of nonlinear filtering includes the step 
of repeating a plurality of filtering wherein 
at said plurality of filtering, said pixels value of 
the input image is sampled at different pitch 
from each other and the high frequency com- 
ponent of the image is suppressed while pre- 
serving edges of the image. 

8. The method according to claim 6, wherein said step 
of nonlinear filtering is performed by sampling con- 
tinuous pixels at a prescribed pitch. 

9. The method according to claim 6, wherein said step 
of nonlinear filtering includes the steps of: 

generating an approximation function approxi- 
mating low frequency components of pixel val- 
ues of pixels within a prescribed extent based 
on a pixel to be processed; 
setting a region corresponding to said low fre- 
quency components on a basis of said approx- 
imation function; 

replacing selectively pixel a value, which is 
judged to be within said region by judging 
whether said pixel value is within said region or 
not concerning respective pixel values in the 
prescribed extent based on said pixel to be 
processed, with a corresponding pixel value of 
said approximation function in accordance with 
a result of said judging; and 
performing weighted addition operation of said 
pixel value replaced at said step of replacing. 
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10. The method according to claim 2, wherein said gain 
correction coefficient with respect to an output value 
at said step of smoothing has a monotonically de- 
creasing characteristic. 

5 

1 1 . The method according to claim 5, wherein said step 
of eliminating noises includes coring processing. 

12. The method according to claim 5, wherein said step 

of elimination noises includes processing of a me- 10 
dian filter. 

1 3. The method according to claim 5, wherein said step 
of elimination noises comprises the steps of: 

15 

replacing selectively a pixel value after judging 
based on a pixel value of a pixel to be proc- 
essed concerning pixel values in a prescribed 
extent based on said pixel to be processed in 
accordance with said judging; and 20 
performing weighted addition operation of said 
pixel value replaced at said step of replacing. 

14. The method according to claim 2, said method fur- 
ther comprising the steps of: 25 

normalizing a color difference signal compo- 
nent of said input image by means of a lumi- 
nance signal component of said input image 
beforehand to provide a pixel value based on 30 
the luminance signal component to said steps 
of smoothing and correcting said pixel value; 
and 

correcting a pixel value of said color difference 
signal after normalizing by means of said pixel 35 
value based on said luminance signal compo- 
nent after said pixel value correcting. 

15. An apparatus including an image processing circuit 

for compressing a dynamic range of an input image ; 40 
said circuit, wherein: 

said image processing circuit is the image 
processing circuit according to claim 1 . 

45 
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